Hands in Action: Real-Time 3D Reconstruction of Hands in Interaction with Object
نویسندگان
چکیده
This paper presents a method for vision based estimation of the pose of human hands in interaction with objects. Despite the fact that most robotics applications of human hand tracking involve grasping and manipulation of objects, the majority of methods in the literature assume a free hand, isolated from the surrounding environment. Our hand tracking method is non-parametric, performing a nearest neighbor search in a large database (100000 entries) of hand poses with and without grasped objects. The system operates in real time, it is robust to self occlusions, object occlusions and segmentation errors, and provides full hand pose reconstruction from markerless video. Temporal consistency in hand pose is taken into account, without explicitly tracking the hand in the high dimensional pose space.
منابع مشابه
Hands and face tracking for VR applications
In this paper, we present a robust real-time 3D tracking system of human hands and face. This system can be used as a perceptual interface for virtual reality activities in a workbench environment. The main advantage of our system is that the human, that is in front of the virtual reality device, do not needs any type of marker or special suite. The system includes a real time color segmentatio...
متن کاملReal-time 3D Feature Extraction without Explicit 3D Object Reconstruction
For the communication between human and computer in an interactive computing environment, the gesture recognition is studied vigorously. Therefore, a lot of studies have proposed efficient methods about the recognition algorithm using 2D camera captured images. However, there is a limitation to these methods, such as the extracted features cannot fully represent the object in real world. Althou...
متن کامل4+4 Fingers Haptic Display in the Mixed Reality Environment
A system with direct manipulation environment is proposed. A user is allowed to use both of his/her hands to manipulate virtual objects in the simulated virtual world. 3D graphical displays with 3D virtual hands represented the user's real hands in the virtual world showing the manipulation works in the virtual world to the user. The 3D virtual hands move corresponding to the behavior of the re...
متن کامل3D Tracking of Human Hands in Interaction with Unknown Objects
The analysis and the understanding of object manipulation scenarios based on computer vision techniques can be greatly facilitated if we can gain access to the full articulation of the manipulating hands and the 3D pose of the manipulated objects. Currently, there exist methods for tracking hands in interaction with objects whose 3D models are known [2]. There are also methods that can reconstr...
متن کاملReal Time Segmentation and Tracking of Face and Hands in VR Applications
We describe a robust real-time 3D tracking system of the extreme limbs of the upper human body, i.e., the hands and the face. The goal of the system is that it can be used as a perceptual interface for virtual reality activities in a workbench environment. The whole system includes an input capture and calibration module, a real time color segmentation module, a data association and tracking mo...
متن کامل